DOCUMENT RESUME 



ED 065 348 



24 



SE 014 429 



AUTHOR 

TITLE 



INSTITUTION 

SPONS AGENCY 
REPORT NO 
BUREAU NO 
PUB DATE 
CONTRACT 
NOTE 



Harris, Margaret L.; Voelker, Alan M. 

An Analysis of Content and Task Dimensions of Science 
Items Designed to Measure Level of Concept 
Attainment. 

Wisconsin Univ. , Madison. Research and Development 
Center for Cognitive Learning. 

Office of Education (DHEW) , Washington, D.C. 

TR- 1 9 8 
BR-5-021 6 
Nov 71 

O EC-5-10- 154 
39p. 



EDRS PRICE MF-$0 .65 HC-$3.29 

DESCRIPTORS Cognitive Processes; ♦Concept Formation; Content 

Analysis; *Evaluation; Intellectual Development; 
♦Scientific Concepts; Test Construction; Thought 
Processes 



ABSTRACT 

Content and task dimensions of science items were 
studied using factor analytic techniques. These items were developed 
to measure concept attainment using a completely crossed design with 
30 concepts and 12 tasks. Conventional factor analyses were 
performed, separately for boys and girls, for concept scores and for 
task scores. Three-mode factor analyses were performed. The main 
conclusions drawn from the results of the conventional factor 
analyses are that all 30 of the concepts are measures of a single 
functional relationship existing among the concepts, and that all 12 
tasks are measures of a single underlying ability or latent trait. 
The three-mode results indicate that there are no important 
concept-task interactions for the idealized persons, thus it is 
reasonable to regard the concepts and the tasks as being two 
independent modes. (Author/CP) 



U.s. DEPARTMENT OF HEALTH. 

EDUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS OOCUMENT HAS BEEN REPRO- 
OUCEO EXACTLY AS RECEIVEO FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS OF VIEW OR OPIN- 
IONS STATEO 00 NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



AN ANALYSIS OF CONTENT 
SAND TASK DIMENSIONS OF 
[SCIENCE ITEMS DESIGNED TO 
[MEASURE LEVEL OF ' 
[CONCEPT ATTAINMENT 



K 












WISCONSIN RESEARCH AND DEVELOPMENT 

CENTER FOR 
COGNITIVE LEARNING 



Ierjci 






V 

t. 





COGNITIVE 

O LEARNING 



( OP>^ 




;\U- 



■ li 



WV*' : - k.J V ’ ’ 

to:.' ' • ■< ; ' 




. -A’ H -4', ^ : 



.v .;;a: 




Technical Report No . 198 



AN ANALYSIS OF CONTENT AND TASK DIMENSIONS OF SCIENCE ITEMS 
DESIGNED TO MEASURE LEVEL OF CONCEPT ATTAINMENT 



by 

Margaret L. Harris and Alan M. Voelker 



Report from the Project on 
A Structure of Concept Attainment Abilities 



Robert E. Davidson, LesterS. Golub, Herbert J. Klausmeier, 
Thomas A. Romberg, B. Robert Tabachnick, Alan M. Voelker 

Principal Investigators 



and 

The Quality Verification Program 
Mary R. Quilling, Director 



Wisconsin Research and Development 
Center for Cognitive Learning 
The University of Wisconsin 
Madison, Wisconsin 

November 1971 



0 



2 



Published by the Wisconsin Research and Development Center for Cognitive Learning, supported 
in part as a research and development center by funds from the United States Office of Education, 
Department of Health, Education, and Welfare. The opinions expressed herein do not necessarily 
reflect the position or policy of the Office of Education and no official endorsement by the Office 
of Education should be inferred. 

Center No. C-03 / Contract OE 5-10-154 



O 

ERIC 



3 



Statement of Focus 



The Wisconsin Research and Development Center for Cognitive 
Learning focuses on contributing to a better understanding of cognitive 
learning by children and youth and to the improvement of related educa- 
tional practices. The strategy for research and development is compre- 
hensive. It includes basic research to generate new knowledge about 
the conditions and processes of learning and about the processes of 
instruction, and the subsequent development of research-based instruc- 
tional materials, many of which are designed for use by teachers and 
others for use by students. These materials are tested and refined in 
school settings. Throughout these operations behavioral scientists, 
curriculum experts, academic scholars, and school people interact, 
insuring that the results of Center activities are based soundly on know- 
ledge of subject matter and cognitive learning and that they are applied 
to the improvement of educational practice. 

This Technical Report is from the Project on the Structure of Concept 
Attainment Abilities in Program 1. The general objectives of this project 
are to identify basic concepts in language arts, mathematics, science, 
and social studies appropriate at a given grade level; to develop tests 
to measure achievement of these concepts; and to develop and identify 
reference tests for cognitive abilities. These will be used to study the 
relationships among learned concepts in various subject matter areas, 
cognitive abilities, and possibly, certain cognitive styles. The result 
of these will be a formulation of a model of structure of abilities in 
concept attainment. 
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Abstract 



Content and task dimensions of science items were studied 
using factor analytic techniques. These items were developed 
to measure concept attainment using a completely crossed design 
with 30 concepts and 12 tasks. Conventional factor analyses 
were performed, separately for boys and girls, for concept 
scores and for task scores. Three-mode factor analyses were 
performed . 

The main conclusions drawn from the results of the conven- 
tional factor analyses are that all 30 of the concepts are measures 
of a single functional relationship existing among the concepts, 
and that all 12 tasks are measures of a single underlying ability 
or latent trait. The three-mode results indicate that there are 
no important concept-task interactions for the idealized persons, 
thus it is reasonable to regard the concepts and the tasks as 
being two independent modes. 
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I 

Introduction 



The primary objective of the Project en- 
titled "A Structure of Concept Attainment Abil- 
ities" (hereafter referred to as the CAA Project) 
is to formulate one or more models or structures 
of concept attainment abilities, and to assess 
their consistency with actual data. The major 
steps for attaining this primary objective were: 

1. To identify basic concepts in language 
arts, mathematics, science, and social 
studies appropriate at the fourth grade 
level , 

2. To develop tests to measure achieve- 
ment of these conceots, 

3. To identify reference tests for cogni- 
tive abilities, and 

4. To study the relationships among learned 
concepts in these four subject matter 
fields and the identified cognitive abil- 
ities. 

This papei contains a report of the factor 
analytic study of the content and task dimen- 
sions of the science items that were developed 
as one aspect of Step 2. The study is a neces- 
sary intermediate step between Step 2 and Step 
4; some reduction in the number of concepts 
for each subject matter field from the 30 select- 
ed ones for which tests were developed is 
mandatory in order to facilitate Step 4. 

Nature of Science Items 

Concepts may be defined ir one or more 
of four ways: (a) structurally, in terms of per- 
ceptible or readily specifiable properties or 
attributes; (b) semantically, in terms of syn- 
onyms or antonyms; (c) operationally, in terms 
of the Procedures employed to distinguish the 
concept from other concepts; or (d) axiomati- 



cally, in terms of logical or numerical relation- 
ships (Klausmeier, Harris, Davis, Schwenn, & 
Frayer, 1968). "A concept exists whenever two 
or more distinguishable objects or events have 
been grouped or classified together and set 
apart from objects on the basis of some common 
feature or property of each M (Bourne, 1966, 
p. 1). A concept adhering to Bourne’s defini- 
tion might be called a classificatory one and 
seemingly is the same as the structural type 
described by Klausmeier, etal. (1968). Such 
a concept definition served as the basis for 
selection and analysis of subject matter con- 
cepts with which this project is concerned. 

Many different types of Performance might 
be taken as the critical evidence that a student 
does or does not understand a given concept. 
Thus, as a part of this project it is necessary 
to have a schema for measuring understanding 
of concepts. Such a schema was developed 
by Frayer, Fredrick, and Klausmeier (1969) 
and was used by the CAA Project to assess 
concept attainment. The '‘Schema for Testing 
the Level of Concept Mastery" consists of 
13 types of questions, each requiring the 
examinee to perform a different task. The 
schema also allows for selection of an answer 
(multiple-choice type questions) or for produc- 
tion of an answer (completion type questions) . 
It was decided to use the first 12 tasks and 
a multiple-choice format for this Project. The 
1 2 tasks of the schema which were used are: 

1 . Given the rftme of an attribute, select 
an example of the attribute . 

2. Given anexample of an attribute, se- 
lect the name of the attribute. 

3. Given the name of a concept, select 
an example of the concept, 

4. Given the name of a concept, select 
a nonexample of the concept. 



5. Given an example of a concept, select 
the name of the concept. 

6. Given the name of a concept, select 
the relevant attribute. 

7. Given the name of a concept, select 
the irrelevant attribute. 

8. Given the definition of a concept, se- 
lect the name of the concept. 

9. Given the name of a concept, select 
the definition of the concept. 

10. Given the name of a concept, select 
the supraordinate concept. 

11. Given the name of a concept , select 
the subordinate concept. 

12. Given the names of two concepts, se- 
lect the relationship between them. 

Single- or compound-word classificatory 
concepts (those that are defined by attributes) 
in science subject matter at the fourth grade 
level were identified. This task was subdi- 
vided into four steps: 

1 . Identifying the major areas within the 
subject matter of science, 

2. Selecting three of these major areas 
to be studied, 

3. Identifying classificatory concepts 
within each of these three major areas, 
and 

4. Random sampling of ten concepts from 
those identified for each of the three 
major selected areas. 

These procedures yielded a total of 30 
science concepts for study. A list is given 
in Table 1 , by area, of the concepts identified 
and randomly selected for study. The areas 
are Biological Science, Earth Science, and 
Physical Science. A description of the proce- 
dures used to identify these concepts can be 
found in "An- Analysis of Selected Classificatory 
Science Concepts in Preparation for Writing 
Tests of Concept Attainment" (Voelker, Soren- 
son, & Frayer, 1971) . 

The researchers of Project 101, Situational 
Variables and Efficiency of Concept Learning, 
developed a system for analyzing a concept in 
preparation for developing items to measure 
the level of attainment of that concept (Frayer, 



Fredrick, & Klausmeier, 1969). Since the 
publication of that paper they, in cooperation 
with the researchers of the CAA Project, have 
refined their thinking and advanced this system . 
The refinements are discussed in "A Structure 
of Concept Attainment Abilities: The Problem 
and Strategies for Attacking It" (Harris, Harris, 
Frayer, & Quilling, in press). Briefly, a con- 
cept may be described in many ways: in terms 
of its criterial, relevant, and irrelevant attrib- 
utes; its examples and nonexamples; its supra- 
ordinate, coordinate, and subordinate hierar- 
chical relationships (theoretically determined); 
and its lawful or other types of relationships 
to other concepts. Knowledge of each of these 
kinds of information may be tested to determine 
a student’s level of attainment of a concept. 

An analysis, along these lines, of each of the 
30 sampled science concepts which are being 
studied can be found in "An Analysis of Select- 
ed Classificatory Science Concepts in Prepara- 
tion for Writing Tests of Concept Attainment" 
(Voelker, Sorenson, & Frayer, 1971). 

Thus , using the analysis of a concept as 
the basis for appropriate tasks , 12 items, one 
for each of the 12 tasks, could be developed 
for each of the 30 concepts making a total of 
360 science items. A description of the pro- 
cedures used in the development of these items, 
along with item and total score statistics (for 
concepts and for tasks) obtained for them for 
beginning sixth grade boys and girls can be 
found in "Measuring Science Concept Attain- 
ment of Elementary School Boys and Girls" 
(Voelker & Harris, in press). The items can 
be found in "Items for Measuring the Level 
of Attainment of Selected Classificatory Sci- 
ence Concepts by Intermediate Grade Children" 
(Voelker & Sorenson, 1S71). 

The study of the dimensionality of the two 
modes, concepts (content) and tasks, of this 
completely crossed design used to develop 
items to measure concept attainment in science 
will be discussed in the following sections. 

Hypothesized Factor Structures 

Alternative sets of factors were postulated 
for the science concepts and for the tasks using 
science content by viewing the concepts and 
the tasks as two independent modes. Viewing 
them in this way is essentially hypothesizing 
that no important interactions exist between 
the two modes . 



Concepts 

The most general hypothesis is that just 
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Table 1 

Lists of Science Concepts by Topical Area 



Biological Science 


Earth Science 


Physical Science 


Adaptation 


Air Pressure 


Burning 


Amphibian 


Atmosphere 


Condensation 


Animal 


*Cloud 


^Conductor 


*Bird 


*Core 


Contraction 


Brain 


Crust ' 


Degree 


*Cell 


*Fossil 


Dissolve 


Eardrum 


*Glacier 


'^Evaporation 


Environment 


Igneous rock 


^Expansion 


*Fish 


Magma 


Force 


*Heart 


Mantle 


^Friction 


Hibernate 


Metamorphic rock 


Fuel 


^Invertebrate 


*Meteor 


Gas 


*Lens - eye 


Meteorite 


^Liquid 


Ligament 


Mineral 


Magnet 


*Lungs 


*Moon 


Matter 


*Mammal 


Orbit 


*Melting 


*Muscle 


*Planet 


Molecular movement 


Nervous system 


Season 


^Molecule 


Optic nerve 


^Sedimentary rock 


Non-conductor 


Plant 


Solar system 


*Solid 


*Pore 


Star 


*Sound 


Re ptile 


Sun 


Temperature 


Retina 


^Volcano 


^Thermometer 


Sense 

Skeleton 

Survival 

Vertebrate 

Water 


Weather 

*Wind 


Work 



^Indicates that a test was developed and administered for this concept. 



one common factor underlies the selected sci- 
ence concepts. Next in the order of generality 
to specificity is that three common factors are 
present, owe for each of the three major areas 
selected for study: Biological Science, Earth 
Science, and Physical Science. A more spe- 
cific hypothesis is that there may be two or 
more common factors for each of the three areas. 
A structure of the concepts within each of the 
three areas was not hypothesized. Instead, 
it was preferred to randomly sample concepts 
from each area and see what functional rela- 
tionships exist among those sampled concepts. 

It was felt that this would eliminate bias in 
the picture of the dimensionality of the con- 
cepts imposed by theoretical relationships 
that may or may not exist in actuality. If 
attainment of concepts is highly specific, 
this approach may be detrimental as there may 
not be at least two measures (concepts) of a 



concept dimension included. There are some 
indications that the concepts are not this spe- 
cific. For example, fairly reliable task scores 
obtained by totalling across the 30 concepts 
for a single task were obtained. This indicates 
some degree of homogeneity among the con- 
cepts . 

Tasks 

The most general hypothesis is that just 
one common factor or ability underlies the 12 
tasks. A more specific hypothesis is that 
there are five underlying abilities: an ability 
dealing with attributes (Tasks 1 and 2), one 
dealing with examples of a concept (Tasks 3, 

4, and 5), one related to the definition of a 
concept (Tasks 6, 7, 8, and 9), 1 one related 

lA concept is defined in terms of its 
relevant attributes. 
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to hierarchical relationships (Tasks 10 and 
11), and one for a relationship of a concept 
with another concept (Task 12). A somewhat 
more specific hypothesis is that there are 
six abilities: the five just listed, with the 

exception that the ability related to the 
definition of a concept may be further spe- 
cific to those tasks dealing with relevant 
and irrelevant attributes (Tasks 6 and 7) 
and those tasks dealing directly with a def- 
inition (Tasks 8 and 9). 



These alternative sets of factors represent 
an a priori analysis of the science concepts 
and the tasks when using science content. A 
major question to be answered in this study 
is the extent to which the obtained factors 
parallel such hypothesized analyses. Note 
that, as discussed, several levels of speci- 
ficity are postulated. Another question to be 
answered in this study is the extent to which 
the concepts and the tasks are independent 
as hypothesized. 







4 




11 



i 






II 

Procedure* 



Subjects 

Pilot studies revealed that the selected 
concepts were very difficult for fourth graders. 
Thus, the decision was made to test fifth grade 
students on the concepts identified and sampled 
from the fourth grade textbooks . Items were 
administered during the fall of 1970 to 186 
boys and 259 girls who were Just beginning 
the sixth grade in the public school system 
of Madison, Wisconsin. The subjects were 
those students who volunteered to participate 
in response to a letter sent to random samples 
from the population of all such boys and from 
the population of all such girls. Approximately 
60% of those invited to participate responded 
affirmatively. The subjects who completed 
the testing program were paid $7,50, 

Since the participation of all students 
comprising the random sample was impossible 
to attain, test score and IQ data were obtained 
from the files of the Madison School System 
for both the school population and those par- 
ticipating students for whom the information 
was available. Table 2 includes the summary 
statistics for the population of fifth grade 
students in the public school system of the 
city of Madison during the school year 1969- 
70, and for the boys and the girls who com- 
prised the tested samples for the science items. 
These data indicate that there was little differ- 
ence between the volunteer group and the 
population. The IQ scores were obtained in 
the fall of 1968 when the subjects were fourth 
graders, and the scores on the Iowa Tests of 
Basic Skills, given in grade equivalent scores, 
were obtained in the fall of 1969 when the sub- 
jects were fifth graders. 

Data on fathers' occupations were collected 
from the tested students using the Master Occu- 
pational Code of the United States Bureau of 
the Census. These data were tabulated and 
are presented in Table 3, 



Data Collection 

The data were collected during five 2-hour 
testing sessions from mid-October to early No- 
vember. Since a large percentage of sixth 
graders attended one of three middle schools, 
it was decided to test the selected students 
from those schools in their own buildings after 
school hours. The sixth grade students attend- 
ing various elementary schools were tested on 
three consecutive Saturday mornings at centrally 
located schools. Each 2-hour session con- 
sisted of a 72-ltem ’'test” composed of science 
items and a 71 -item "test” composed of language 
arts items with an activity break between the 
two. The science and the language arts items 
were administered first on alternate days. 

The 360 science items were arranged in 
five 72-item "tests,” the order of assignment 
being random. Two different random orders 
were used to collect the data: one for each 
type of school (elementary and middle) for 
both boys and girls. The items were arranged 
in five test booklets according to the random 
order. The tests were given by experienced 
test administrators to groups of approximately 
30 subjects each. The students responded to 
the items by marking their chosen response 
directly on an answer sheet. The answer 
sheets were read by machine and the responses 
punched onto data cards. 



Troatmont of tht Data 

The treatment of the data consisted of 
two main procedures: reliability estimation 
and factor analysis. The data were analyzed 
separately for each sample— boys and girls, 
Hoyt analysis of variance reliability estimates 
wore obtained for each of the 30 concept scores 
and each of the 12 task scores for each group 
studied. Means and standard deviations for 



Table 2 

Mean Scores and Standard Deviations on 
l.orge-Thorndlko Intelligence Tost and Iowa Tests of Basic Skills 
for Students in Population and Samples 







Population 


BOVS 


Girls 


Lorgo-Thorndlko 




106.6 


106.11 


112.23 


Intelligence 


8 




14.82 


13.37 




N 


2605 


161 


239 


Iowa Basic Skills 










Vocabulary 


X 


5.53 


5.54 


5.88 




s 




1.41 


1.33 




N 


2520 


181 


246 


Roadlng 

Comprehension 




5.44 


5.29 


5.97 




s 




1.51 


1.35 




N 


2520 


181 


247 


Language 

Skills 


X 


CM 

m 

in 


5.04 


5.82 




s 




1.44 


1.34 




N 


2520 


181 


248 


Work-Study 

Skills 


X 


5.46 


5.41 


5.86 




s 




1.30 


1.18 




N 


2520 


181 


248 


Arithmetic 

Skills 


X 


5.05 


5.08 


5.35 




3 




.96 


1.00 




N 


2520 


181 


247 


Composite 


X 


5.35 


5.27 


5.77 




s 




1.17 


1.11 




N 


2520 


181 


245 



each of the scores were also computed. 



Factor Analysis 

Developing one Item for each of the 1 2 
tasks for each of the 30 selected concepts 
ylj'ds a 12 (tasks) by 30 (concepts) matrix 
consisting of the score for each of the 360 
Items, one for each cell of the matrix, for 
each Individual to whom the Items are admin- 
istered. A completely crossed design exists 
and two types of total scores can be secured 
from this matrix: a total score for each of 
the 30 concepts (totalled across tasks) and 
a total score for each of the 12 tasks (totalled 
across concopts). Figure 1 Is an Illustration 
of such a matrix. Using this design to test 
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concept attainment yields data of a three- 
dimensional type, if more than one concept 
and more than one task are Included. The three 
dimensions are concepts, tasks, and Individuals. 
The application of conventional factor analysis 
procedures to such data presents certain prob- 
lems. As It has been used In the past, the 
researcher commonly collapses one dimension 
of the data, thereby losing Information that is 
possibly very Important. For example, common 
practice would be to use mean scores over the 
set of Individuals to create a two-dimensional 
concept by task matrix which is then "factored." 

Tucker's (1966a, 1966b) three-mode factor 
analysis has made It possible to factor analyze 
three-dimensional data without the potential 
loss of information Involved In collapsing a 
dimension. There are some problems, however, 
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Tablo 3 

Distribution of Fathers' Occupations for Studonts in tho Samplos 





Girls 


Bovs 


00. Accountant 


4 


7 


01 . Architect 


3 


2 


02. Dontlst 


3 


l 


03. Engineer 


10 


7 


04. Lawyer, Judge 


6 


2 


05. Clergyman 


— 


3 


06. Doctor 


12 


3 


07. Nurso 


— 


— 


08. Toochcr, Professor 


20 


15 


09. Other professional 


26 


15 


1 1 . Farmer 


— 


— 


21 . Ownor of business 


4 


2 


22. Manager, Official 


28 


13 


31 . Bookkeeper 


— 


— 


32. Receptionist 


1 


— 


39 . Other clerical 


6 


4 


49. Salesman 


27 


24 


51 . Craftsman, Skilled worker 


39 


22 


52. Foreman 


— 


2 


53. Armed Services - officer 


— 


1 


54. Armed Services - enlisted 


— 


1 


61 . Truck driver 


5 


4 


62. Operative In factory 


16 


11 


69. Other operative 


12 


12 


71. Fireman 


2 


2 


72. Policeman 


2 


4 


73. Other protective service 


3 


— 


74. Nurse's aide 


1 


1 


75 . Private household worker 


— 


— 


79 . Other service worker 


14 


16 


81 . Non-farm laborer 


3 


2 


82. Farm laborer 


1 


— 


91 . Not presently in labor force 


6 


6 


99. Not ascertained 


12 


10 



In applying the analysis to data collected 
using the concept by task design with one 
Item per cell. First, the data for a three-mode 
system are 0-1 data with a single Item per 
cell; thus, there Is a reliability problem with 
single Item variables. Second, the common 
factors In the system are of major Interest 
and the program to which there Is access Is 
for a component type analysis. Third, as In 
ordinary factor analysis, the question of the 
number of factors (components) to extract Is 
a difficult question to answer, and this Infor- 
mation has to be Input Into the three-mode 
program. For these reasons tho procedures 
outlined here were used for factor analyzing 
the science data collected using the schema 
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for testing level of concept attainment. 

Briefly, the strategy consists of perform- 
ing conventional factor analyses separately 
for the concepts and for the tasks to gain some 
Insight into the Interrelationships among the 
variables of a single mode. Tucker's three- 
mode factor analysis was then used to deter- 
mine If there are any Important concept-task 
Interactions for the idealized persons (person 
factors) . 

Conventional Factor Analyses . The orig- 
inal plans called for determining the compar- 
able common factors, separately for the con- 
cepts and for the tasks, by using a strategy 
suggested by Harris and Harris (1970). This 
strategy Is a way to determine those factors 
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CONCEPTS 





Area: 

Biological Science 
1 2 10 


Area: 

Earth Science 
11 12 20 


Area: i 

Physical Science 
21 22 30 


Total Score 
for Tasks 


1 

2 

• 

TASKS 

• 

• 

• 

12 
























Total Score 
for Concepts 







Fig. 1. Item matrix for each individual, 



that are robust with respect to method— factors 
which tend to include the same variables across 
methods. Analyses were obtained using three 
initial factor methods: Alpha (Kaiser & Caffrey, 
1965), Harris R-S 2 (Harris, 1962), and Unre- 
stricted Maximum Likelihood Factor Analysis 
(UMLFA) (Joreskog, 1967). These three methods 
provide a factor solution with a statistical basis 
with the number of factors determined by a sta- 
tistical test (UMLFA), and two factor solutions 
with a psychometric basis: one for a relatively 
small number of factors (Alpha) and one for a 
relatively large number of factors (Harris R-S 2 ). 
All three of the methods are independent of 
the scale of the variables. Derived orthogonal 
solutions were obtained for each of the three 
initial solutions using the Kaiser normal vari- 
max procedure (Kaiser, 1958), and derived 
oblique solutions were obtained using the Harris- 
Kaiser independent cluster solution (Harris & 
Kaiser, 1964). 

The "right number of factors" question is 
one for which there is still no definitive answer. 
For matrices which yin'd about the same number 
of factors when diffi it methods are used, 



Harris and Harris (1970) suggest taking the 
comparable common factors as the substantive 
results. Doing This, the number of factors can 
be more or fewer than the number of factors 
for any single solution. This idea does not 
seem to be appropriate when the number of 
common factors obtained using different methods 
varies considerably, as is the case, for exam- 
ple, with the factoring of the science concepts: 
for boys and girls respectively, 1 each for 
Alpha, 8 and 7 for Harris R-S 2 , and 2 and 3 
for UMLFA for both the derived orthogonal and 
derived oblique solutions. (These results will 
be presented and discussed in detail in the 
next section.) 

Alpha sometimes underfactors, and under- 
factoring is, according to Kaiser, "an unfor- 
givable sin." Harris R-S 2 extracts a relatively 
large number of factors (Kaiser calls it delib- 
erate overfactoring); but this is no problem 
since derived orthogonal common factors retain 
the important things, get rid of the "garbage," 
and are in no way substantially affected by 
doing so (Kaiser, 1970). As an example, for 
the science concepts, Harris R-S 2 extracted 
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17 factors initially for both the boys and the 
girls but the derived orthogonal solutions 
trimmed these to 8 common factors for boys 
and 7 for girls, Kaiser (1970) advocates this 
"deliberate overfactoring" but says he wishes 
oblique transformations were robust to it which 
they are not. This problem was "solved" by 
not submitting the initial raw factor matrix to 
oblique rotation. Instead, the common factors 
o? the derived orthogonal solution were taken 
as F and used to build R*. The Q obtained 
from a principal axes decomposition of R* then 
was submitted for oblique transformation. 

Thus: derived orthogonal common factors « F: 

FF' = R*; R* - QD2q’; and then this Q is trans- 
formed to give an oblique solution. It may be 
pointed out here that getting derived oblique 
factors from the initial raw factor matrix or 
from the 0 obtained from R* will not make any 
difference if the number of initial factors and 
the number of derived orthogonal common fac- 
tors is the same; this is the case for the factors 
obtained for the science concepts and tasks 
using both Alpha and UMLFA, Incidentally, 
Kaiser (1970) in the same paper advocates 
obtaining "Harris factors" as they are model - 
free . What is named Harris R-S^ is one of 
the set of "Harris factors," 

Discussion of the number of factors is 
important since it is necessary to input the 
number of factors for concepts and the number 
of factors for tasks into the three-mode program. 
For these science data the number of factors 
used was the number of Harris R-S^ derived 
oblique common factors for the concepts and 
the number of UMLFA derived oblique common 
factors for the tasks. The main reason for 
this is that these solutions give as many or 
more common factors as the other two solutions 
and greater specificity should allow any con- 
cept-task interactions to be more demonstrable. 

Three-Mode Factor Analyses . As was men- 
tioned earlier in the paper, three-mode factor 
analyses (Tucker, 1966a, 1966b) were performed 
to determine if there are any important concept- 
task interactions for the idealized persons. 

Three problems were mentioned at that time. 

Two of them were "solved" by doing the con- 
ventional factor analyses. The common factors 
in each of the two modes, concepts and tasks, 
were obtained and the number of factors (com- 
ponents) to input into the three-mode program 
for the two modes other than individuals was 
determined'. The third problem still remains — 
the reliability problem with single item variables 
consisting of 0-1 type data. To alleviate this 
problem, a three-mode analysis was performed 
on two different forms of the same data in an 
attempt to gain insight into the existence of 



any important concept-task interactions , It 
might also be pointed out that the existing 
program has the capacity to handle only a 
product of 1 20 for the two modes other than 
individuals. Thus, we could not analyse our 
30 concepts by 12 tasks, as this gives a 
product of 360. It would have been possible 
to expand the program's capacity to some 
extent, but it would have been very difficult, 
it not impossible, to expand It to handle a 
product of 360 , 

Conceptually, the 30 concepts were 
organized into three areas within the subject 
matter field. This categorization was done 
by subject matter experts, A three-mode 
analysis was conducted using only three vari- 
ables for concepts. Each of these variables 
is a composite of the items for a single task 
across the ten concepts within a single area. 
Thus, the input data for this analysis con- 
sisted of a 3 (concepts) by 12 (tasks) matrix 
of 36 entries for each individual. Each entry 
consisted of the total number correct of ten 
items. The number of factors (components) 
for concepts input for this analysis was taken 
as three. The number of factors (components) 
for tasks input for this analysis was the num- 
ber of derived oblique factors obtained for 
the UMLFA method— three for both boys and 
girls. This analysis will be referred to as 
Type I three-mode analysis. Such an analysis 
should permit any task interactions to be clearly 
evident, as each task is a seoarate entry; 
actually each task comprises three separate 
entries, one for each composite concept vari- 
able . 

A second three-mode analysis, to be re- 
ferred to as Type II, was conducted using all 
30 of the concepts but only three task variables. 
The task variables are composites of the items 
for a single concept for given tasks, The com- 
posites formed for boys are: 

Task Variable A - Tasks 1 , 2, and 4 
Task Variable B - Tasks 3 and 5 
Task Variable C- Tasks 6, 7, 8, 9, 10, 

1 1 , and 1 2 

The composites formed for girls are: 

Task Variable A - Tasks 1, 2, and 5 
Task Variable B - Task? 3 and 4 
Task Variable C- Tasks 6, 7, 8, 9, 10, 

1 1 , and 1 2 

The formation of the composites was based on 
the derived oblique factors obtained for the 
UMLFA method. A task was assigned to a 
composite on the basis of its highest factor 
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coefficient. It is realized that this is essen- 
tially forming factor scores using a rather un- 
desirable method, but it was felt that since 
the intercorrelations of the task factors are 
very high (in fact so high that a reasonable 
interpretation is that the 12 tasks are all mea- 
sures of the same latent ability), it would not 
be too detrimental. Also, it provided a way 
of forming composites based on experimental 
results rather than theoretical considerations 
to allow for greater specificity; an alternative 
would have been to input only one variable for 
tasks which would consist of a composite for 
all 12 of the tasks. Thus, the input data for 
this Type II three-mode analysis consisted of 
a 30 (concepts) by 3 (tasks) matrix of 90 entries 
for each individual. Each entry consisted of 
the total number answered correctly for one of 
the three composite task variables consisting 



of three, two, and seven items respectively. 
The number of factors (components) for tasks 
input for this analysis was taken as three. 

The number of factors (components) for con- 
cepts input for this analysis was the number 
of derived oblique factors obtained for the 
Harris R-S^ method— eight for boys and seven 
for girls. Such an analysis should permit any 
concept interactions to be clearly evident since 
each concept is a separate entry; actually, 
each concept comprised three separate entries, 
one for each composite task variable. There 
still may be somewhat of an unreliability 
problem in this analysis, as some of the 
entries consist of the total score for just 
two items. 

The results of treating the data in these 
various ways are presented and discussed in 
the following section. 



p 






III 

Results and Discussion 



The means, standard deviations, and 
Hoyt reliability estimates obtained for the 
data collected during summer and fall of 1970 
using the science items developed are pre- 
sented, separately for boys and girls, for total 
concept and total task scores. The intercor- 
relations and factor results for these data are 
presented and discussed, once again separately 
for boys and girls. 



Reliability Estimates and Tut Statistics 

Tables 4 and 5 contain the means, stan- 
dard deviations, and Hoyt reliability estimates 
obtained for the data collected during fall, 

1970, using the revised items for total concept 
and total task scores. The data were analyzed 
separately for the 186 boys and the 259 girls. 
The concept scores consist of 1 2 items each, 
and the task scores of 30 items each. 

The mean scores for concepts are generally 
slightly higher for girls than they are for boys; 
girls attained a higher mean score for 25 of 
the 30 concepts, but the difference approached 
one score point, which is less than one-half 
of a standard deviation, for only one of the 
concepts. The mean scores for tasks are also 
slightly higher for girls than for boys; girls 
attained higher mean scores than the boys for 
all 12 of the tasks. These differences are 
generally less than one-fourth of a standard 
deviation. 

The reliability estimates are generally 
slightly higher for boys than for girls. For 
the task scores they are in the .80s for boys 
with the exception of one which is .76, and 
in the .70s and .80s for girls with the excep- 
tion of one which is .66. For the concept 
scores the reliability estimates are in the 
.60s and .70s for boys and the .50s to .70s 
for girls. It is to be expected that the task 
scores are more reliable than the concept 



scores since the task scores are based on 
30 items while the concept scores are based 
on only 1 2 items . 

The reliability estimates are sufficiently 
high to warrant study of the dimensionality of 
these selected science concepts and the tasks 
when using science content. This is a major 
objective of the CAA Project and is the main 
purpose for developing these items to measure 
science concept attainment. 



Factor Analysts 

The correlation matrices for the concept 
scores upon which the factor analyses were 
based are given in Table 6 for boys and Table 
7 for girls. The intercorrelations for the task 
scores are given in Table 8 for boys and Table 
9 for girls . 

The Intercorrelations of the concept scores 
are quite consistent in magnitude within the 
matrix for both boys and girls. The correlations 
are in the .5 0s to mid .70s for boys and the 
.40s to low .70s for girls. The reliability esti- 
mates obtained for the concept scores range 
from .60 to .79 for boys and from .52 to .78 
for girls. Thus, if the correlations were cor- 
rected for attenuation they would all be quite 
high. The lower correlations obtained are 
almost wholly associated with the concept 
scores which have low reliability estimates. 

The Intercorrelations of the task scores 
are quite consistent in magnitude for boys and 
girls. They are in the .70s and .80s for both 
boys and girls with a few in the .60s which 
are almost entirely for Task 4. Once again, 
it is interesting to look at the reliability esti- 
mates for the task scores. They are in the .80s 
for boys and the .70s and .80s for girls with 
the exception that the reliability estimate for 
Task 4 is .76 for boys and .66 for girls. Thus, 
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Table 4 

Means, Standard Deviations, and Hoyt Reliabilities for Tests of Concept Attainment 
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Table 5 

Means, Standard Deviations, and Hoyt Reliabilities 
for Tests of Task Attainment— Science 



Standard 

, Mean Deviation Hoyt Reliability 

Task 



Number 3 


Bovs 


Girls 


Bovs 


Girls 


Boys 


Girls 


i 


23.17 


24.54 


5.14 


4.51 


.84 


.83 


2 


22.22 


23.44 


5.74 


4.80 


.87 


.84 


3 


23.50 


24.11 


4.46 


3.60 


.80 


.72 


4 


23.34 


23.65 


4.20 


3.38 


.76 


.66 


5 


22.95 


23.57 


5.36 


4.30 


.85 


.78 


6 


18.76 


20.18 


6.10 


5.61 


.85 


.83 


7 


16.76 


18.05 


6.30 


5.74 


.85 


.83 


8 


20.17 


21.37 


6.81 


5.76 


.89 


.85 


9 


19.06 


20.26 


6.48 


5.99 


.87 


.86 


10 


20.67 


21.04 


6.50 


5.94 


.88 


.87 


11 


18.82 


19.49 


5.66 


4.81 


.83 


.77 


12 


17.32 


17.63 


5.90 


5.52 


.83 


.81 



a l. Given name of attribute, select example of attribute. 

2. Given example of attribute, select name of attribute. 

3. Given name of concept, select example of concept. 

4. Given name of concept, select nonexample of concept. 

5. Given example of concept, select name of concept. 

6. Given name of concept, select relevant attribute. 

7. Given name of concept, select irrelevant attribute. 

8. Given definition of concept, select name of concept. 

9. Given name of concept, select definition of concept. 

10. Given name of concept, select supraordinate concept. 

11. Given name of concept, select subordinate concept. 

12. Given names of two concepts, select principle relating them. 



Table 6 

Intercorrelations of Science Concepts: Boys 
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a Decimals have been omitted. 



Table 7 

Intercorrelations of Science Concepts: Girls 
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a Decimals have been omitted 



Table 8 

Intercorrelations of Science Tasks: Boys a 



Task 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


2 


88 






















3 


80 


79 




















4 


72 


75 


73 


















5 


83 


86 


86 


74 
















6 


77 


79 


70 


71 


76 














7 


75 


79 


67 


64 


72 


84 












8 


82 


86 


76 


70 


83 


86 


81 










9 


78 


82 


72 


70 


80 


89 


83 


89 








10 


83 


84 


77 


72 


83 


84 


82 


87 


86 






11 


80 


82 


72 


68 


81 


85 


80 


86 


86 


83 




12 


72 


76 


66 


67 


71 


83 


80 


82 


85 


79 


80 


a Decimals have been omitted. 





Table 9 

Intercorrelations of Science Tasks: 


Girls 


a 






Task 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


2 


82 






















3 


76 


79 




















4 


66 


73 


76 


















5 


76 


81 


80 


75 
















6 


77 


78 


71 


62 


73 














7 


74 


71 


69 


56 


66 


80 












8 


82 


82 


74 


66 


76 


83 


75 










9 


81 


80 


77 


69 


77 


84 


80 


87 








10 


79 


80 


76 


70 


77 


83 


76 


86 


86 






11 


74 


76 


72 


67 


72 


79 


75 


82 


84 


82 




12 


73 


72 


71 


62 


71 


79 


77 


78 


82 


81 


78 



a Decimals have been omitted. 



as with the concepts , if the correlations were 
corrected for attenuation, they would almost 
all be extremely high. The uncorrected correla- 
tions are all quite high. 

Conventional Factor Analyses 

The numbers of factors obtained for the 
initial solutions and for the derived solutions, 
orthogonal and oblique, are given in Tables 10 
and 11 according to the numbers of common, 
specific, and null factors, A common factor 
is defined as one having at least two variables 



with coefficients greater than .30 (absolute) 

A specific factor has only one coefficient 
greater than .30 (absolute), and a null factor 
does not ‘have any coefficients greater than 
.30 (absolute). The factors rotated for the 
derived oblique solutions were the orthogonal 
common factors obtained for that method. For 
this purpose a common factor was defined as 
one having at least two variables with coef- 
ficients greater than .300 (absolute). 3 



^After rounding to two places. 

^ After rounding to three places. 
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Table 10 

Numbers of Initial and Derived Factors for Concept Scores: Boys and Girls 



Factor 

Method 


Initial 

Factors 


Derived Orthogonal Factors 
Common Specific Null 


Derived Obllaue Factors 
Common Specific Null 




B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


Alpha 


1 


1 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


0 


0 




Harris R-S 2 


17 


17 


8 


7 


1 


2 


8 


8 


8 


7 


0 


0 


0 


0 




UMLFA 


2 


3 


2 


3 


0 


0 


0 


0 


2 


3 


0 


0 


0 


' 0 





Table 11 

Numbers of Initial and Derived Factors for Task Scores: Boys and Girls 



Factor 

Method 


Initial 

Factors 


Derived Orthogonal Factors 
Common Specific Null 


Derived Oblique Factors 
Common Specific Null 


B 


G 


B 


G 


B 


G 


3 


G 


B 


G 


B 


G 


B 


G 


Alpha 


1 


1 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


0 


0 


Harris R-S 2 


5 


4 


2 


2 


0 


1 


3 


1 


2 


2 


0 


0 


0 


0 


UMLFA 


3 


3 


3 


3 


0 


0 


0 


0 


3 


3 


0 


0 


0 


0 



The derived orthogonal common factor 
results can be found in Appendices A-D; the 
derived oblique common factor results are pre- 
sented in Tables 12-15. Only coefficients 
greater than .30 (absolute) are included. The 
order of the factors for each solution is arbi- 
trary. The intercorrelations of the factors are 
included in the tables for the oblique solutions. 

Interpretation of Factor Results for Con - 
cept Scores . The factor results for the concepts 
can be interpreted at two levels. One of these 
is the general level. The most reasonable 
interpretation is that all 30 of the concepts are 
measures of a single functional relationship 
existing among the concepts; this holds for 
both boys and girls. At least four things lead 
to such an interpretation. First, the intercor- 
relations of the 30 concepts are all quite uni- 
form. They would probably fit a Spearman 
pattern fairly well; this indicates a single 
common factor. The correlations, if corrected 
for attenuation, would all be quite high. The 
eigenvalues of the correlation matrices ob- 
tained for both boys and girls are characterized 
by the first one being very large followed by a 
great drop in magnitude to the next ones which 
diminish very gradually. Finally, the oblique 
factor intercorrelations are uniformly extremely 



high, indicating only one second-order factor. 
Such an Interpretation is reasonable in terms 
of past studies, also. In the literature for 
factor studies that Include measures of achieve- 
ment, the results typically indicate that achieve 
ment measures are found on a single factor. We 
have here achievement measures for a single 
subject matter field which, conceptually at 
least, should be even more closely related than 
achievement measures from several different 
areas of study. 

The other level at which the factor results 
can be interpreted is a more specific one. The 
derived orthogonal factors are not very meaning- 
ful; they are not very interpretable psychologi- 
cally. As can be seen from Tables 12 and 13, 
the oblique factors are very highly correlated; 
thus, imposing the restriction of orthogonality 
on the factors for these sets of data gives 
results that are not very meaningful. Many of 
the variables are of complexity 2, 3, and even 
higher in the orthogonal solutions . For exam- 
ple, for the two factors of the UMLFA solution 
for boys, all of the concepts have coefficients 
greater than .30 on both of the factors; for the 
girls, 21 of the concept variables are of com- 
plexity 3 for the three factors of the UMLFA 
solution. Even for the greater number of factors 
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Table 12 

Oblique Common Factor Results for Science Concepts: Boys 3 



Alpha Harris R-S^ UMLFA 



Concept 


A-l 


H-l 


H-2 


H-3 


H-4 


H-5 


H-6 


H-7 


H-8 


U-l 


U-2 


Area: Biological Science 
























1 Bird 


77 


93 
















63 




2 Cell 


74 






65 














97 


3 Fish 


82 


46 


50 






-34 








131 


-47 


4 Heart 


84 




42 














54 


32 


5 Invertebrate 


73 














75 




60 




6 Lens 


77 


-36 


109 
















73 


7 Lungs 


86 


63 
















94 




8 Mammal 


77 


37 














62 


96 




9 Muscle 


82 




47 




56 












58 


1 0 Pore 


83 


43 






41 










45 


40 


Area: Earth Science 
























11 Cloud 


86 


31 














33 


33 


54 


1 2 Core 


80 








99 










60 




13 Fossil 


83 


52 










64 






99 




14 Glacier 


81 


115 


-32 














92 




15 Meteor 


80 












96 








72 


16 Moon 


81 


33 


















77 


17 Planet 


83 


















37 


47 


18 Sedimentary Rock 


75 




45 


31 












39 


36 


19 Volcano 


84 


50 


75 














74 




20 Wind 


84 


72 






32 










80 




Area: Physical Science 
























21 Conductor 


71 






67 












-33 


105 


22 Evaporation 


83 




















98 


23 Expansion 


82 
















83 




95 


24 Friction 


76 


-54 












37 


57 




64 


25 Liquid 


77 
















108 




53 


26 Melting 


81 




















52 


27 Molecule 


74 










60 








-40 


115 


26 Solid 


83 


67 














65 


49 


35 


29 Sound 


81 












73 






34 


48 


30 Thermometer 


81 




63 




31 






-35 


39 


66 





Intercorrelations of 


2 


93 










95 


factors 


3 


81 


84 












4 


91 


91 


79 










5 


75 


79 


78 


75 








6 


91 


92 


82 


90 


79 






7 


86 


88 


76 


87 


68 


84 




8 


95 


93 


86 


92 


80 


92 87 



includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 
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Table 13 

Oblique Common Factor Results for Science Concepts: Girls 3 



Concept 


Alpha 

A-l 


H-l 


H-2 


Harris R-S 
H-3 H-4 


2 

H-5 


H-6 


H-7 


U-l 


UMLFA 

U-2 


U-3 


Area: 


Biological Science 
























1 


Bird 


68 






109 














84 


2 


Cell 


65 




82 














86 




3 


Fish 


78 






52 








40 


75 


-43 


49 


4 


Heart 


78 














96 


74 






5 


Invertebrate 


67 










51 












6 


Lens 


64 


97 














79 






7 


Lungs 


84 


32 












62 


116 






8 


Mammal 


76 


40 




66 










44 




58 


9 


Muscle 


72 




37 






33 






33 


62 




10 


Pore 


80 








50 


39 






74 






Area: 


Earth Science 
























11 


Cloud 


80 










39 


41 


-32 




39 




12 


Core 


74 


50 














75 






13 


Fossil 


80 






70 














85 


14 


Glacier 


76 










35 






63 






15 


Meteor 


78 




50 














76 




16 


Moon 


80 




41 




37 










98 




17 


Planet 


81 








52 








37 


56 




18 


Sedimentary Rock 


69 


87 














90 






19 


Volcano 


76 
















38 






20 


Wind 


78 














53 


100 






Area: 


Physical Science 
























21 


Conductor 


66 




32 














90 




22 


Evaporation 


81 








38 


31 








73 




23 


Expansion 


79 








81 










52 




24 


Friction 


73 








107 










74 




25 


Liquid 


80 








38 








41 


32 




26 


Melting 


78 












91 






39 




27 


Molecule 


65 










100 






35 


33 




28 


Solid 


79 












63 




37 






29 


Sound 


80 


-40 




58 






56 








97 


30 


Thermometer 


70 












76 




40 







Intercorrelations of 


2 


80 










93 


factors 


3 


89 


82 








92 91 




4 


90 


85 


90 










5 


90 


84 


89 


91 








6 


92 


83 


92 


93 


91 






7 


92 


80 


90 


87 


90 > 90 





includes those variables which have coefficients greater than .30 (absolute), 
Decimals have been omitted. 
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Table 14 

Oblique Common Factor Results for Science Tasks: Boys a 





Alpha 


Harris R-S 2 




UMLFA 


Task 


A-l 


H-l H-2 


U-l 


U-2 U-3 


1 Given name of attribute, select example. 


89 


79 


120 




2 Given example of attribute, select name. 


92 


72 


69 




3 Given name of concept, select example. 


83 


112 


46 


54 


4 Given name of concept, select nonexample. 


79 


74 


39 




5 Given example of concept, select name. 


90 


97 




116 


6 Given concept, select relevant attribute. 


91 


102 




105 


7 Given concept, select irrelevant attribute. 


87 


98 




93 


8 Given definition of concept, select name. 


93 


75 




78 


9 Given name of concept, select definition. 


92 


99 




105 


10 Given concept, select supraordinate concept. 


93 


34 60 




61 


11 Given concept, select subordinate concept. 


91 


77 




76 


12 Given two concepts, select relationship. 


86 


106 




108 


Intercorrelations of factors: 2 




91 


91 




3 






93 


87 


includes those variables which have coefficients greater than .30 (absolute). 




Decimals have been omitted. 











Table 15 

Oblique Common Factor Results for Science Tasks: Girls 3 




Task 


Alpha 

h-i 


Harris R-S 2 
H-l H-2 


U-l 


UMLFA 
U-2 U-3 


1 


Given name of attribute, select example. 


88 


35 


51 


102 






2 


Given example of attribute, select name. 


89 


63 




101 






3 


Given name of concept, select example. 


86 


85 




37 


53 




4 


Given name of concept, select nonexample. 


77 


103 






96 




5 


Given example of concept, select name. 


86 


84 




52 


44 




6 


Given concept, select relevant attribute. 


89 




99 






79 


7 


Given concept, select irrelevant attribute. 


83 




106 






90 


8 


Given definition of concept, select name. 


91 




82 


49 




56 


9 


Given name of concept, select definition. 


93 




87 






87 


10 


Given concept, select supraordinate concept. 


92 




78 






80 


11 


Given concept, select subordinate concept. 


88 




81 






94 


12 


Given two concepts, select relationship. 


86 




96 






107 


Intercorrelations of factors: 2 




91 




90 








3 








94 


83 





^Includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 



for the Harris R-S^ solutions, there are still 
a large number of concept variables of com- 
plexity 2, 3, 4, and even 5. Thus, at a more 
specific level, it makes sense to interpret only 
the oblique solutions. It must be remembered, 



however, that the correlations of these factors 
are all extremely high. 

For matrices which yield about the same 
number of factors when different methods are 
used, Harris and Harris (1970) suggest taking 
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the comparable common factors, those that 
are robust over method, as the substantive 
results. This idea does not seem to be appro- 
priate when the number of common factors ob- 
tained using different methods varies consider- 
ably, as is the case with the factoring of these 
science concepts: for boys and girls respec- 
tively, 1 each for Alpha, 8 and 7 for Harris 
R-S 2 , and 2 and 3 for UMLFA. Thus, it seems 
the only appropriate thing is to look at the 
results for each method individually. 

The results for the boys are given in 
Table 12. For these science concepts, Alpha 
yielded just one common factor. The coeffi- 
cients on this factor are all quite uniform for 
the 30 concepts . 

The UMLFA method yielded two common 
factors, but they are correlated .95 which 
makes it academic to place any emphasis on 
the distinctions between the two. There is 
really no good rationale for explaining them. 

One could say that U-l is associated mainly 
with the concepts from the two areas Biological 
Science and Earth Science, and that U-2 is 
associated mainly with the concepts from the 
area of Physical Science. These distinctions 
are not really very clear, however, as ten of 
the variables are of complexity 2 and each of 
the two factors includes some concepts from 
each of the three areas . 

The Harris R-S 2 solution is, in general, 
much more difficult to interpret than the others. 
Even with the greater number of factors and 
the relatively small number of variables on each 
of the factors, the factors are still moderately 
to extremely highly correlated. Adding to the 
difficulty of the interpretation is the fact that 
14 of the concept variables are of complexity 
2, 3, and 4. Of these 14, 5 are bipolar. All 
of this seems to add credence to the interpre- 
tation of a single functional relationship exist- 
ing among the 30 concepts studied. H-l is 
the most general of the Harris R-S 2 factors 
including five concepts from Biological Science, 
six from Earth Science, and one from Physical 
Science. In addition, there are two negative 
coefficients. There appears to be no apparent 
.explanation for this factor. It includes a rather 
odd assortment of concepts and a "more-less 
familiar” interpretation does not seem to be 
justified either. There seems to be no rationale 
for explaining H-2 which includes Lens, Vol- 
cano, Thermometer, Fish, Muscle, Sedimentary 
Rock, and Heart. H-3 is comprised mainly of 
the two concepts Conductor and Cell. Core, 
Muscle, and Pore are the main concepts appear- 
ing on H-4; Wind and Thermometer have small 
coefficients on this factor. H-5 is essentially 
a specific for the concept Molecule. The three 



concepts Meteor, Sound, and Fossil appear 
on H-6. H-7 is essentially a specific for 
the concept Invertebrate. Liquid, Expansion, 

Solid, and Friction are four concepts from 
Physical Science with a logical relationship, 
but it is curious why Mammal should appear 
with them on H-8. Also appearing on H-8 
but with much smaller coefficients are Thermo- 
meter and Cloud. 

The results for the girls interpreted here 
are given in Table 13. As with the boys, Alpha 
yielded just one common factor. 

The UMLFA method yielded three factors 
for girls as compared to two for boys . The 
intercorrelations of these three factors are in 
the low .90s. U-l and U-2 are similar to the 
two factors of the UMLFA solution for boys. 

U-l includes many of the Biological Science 
and Earth Science concepts and a few concepts, 
with smaller coefficients, from the area of 
Physical Science; U-2 includes many of the 
Physical Science concepts with Moon, Meteor, 
Planet, and Cloud from Earth Science and Cell 
and Muscle from Biological Science also ap- 
pearing on U-2. U-3 is rather curious. Four 
of the five concepts appearing on it have a 
logical explanation; Bird, Mammal, and Fish 
are the three kinds of living creatures studied 
and they ail can form Fossils. There is no 
explanation for Sound appearing with these 
four concepts, however. It should also be 
noted that the highest coefficient is for the 
concept Sound. 

As with the boys, Harris R-S 2 results are 
much more difficult to interpret than the others. 

For the girls, only 9 of the 30 concept variables 
are of complexity 2 or 3 but the intercorrela- 
tions of the factors are quite high. H-l includes 
Lens, Sedimentary Rock, Core, Mammal, and 
Lungs with Sound being negative. Cell, Meteor, 
Moon, Muscle, and Conductor are the variables 
appearing on H-2. H-3 is similar to U-3; the 
concepts appearing on it are the three kinds 
of creatures studied— Bird, Mammal, and Fish- 
Fossil, and Sound. Friction, Expansion, 

Planet, and Pore are the main concepts appear- 
ing on H-4 with Evaporation, Liquid, and Moon 
appearing with small coefficients. H-5 is essen- 
tially a specific for Molecule or a doublet for 
Moleclue and Invertebrate. Five other concepts 
appear on H-5 but with much smaller coefficients. 
Melting, Thermometer, Solid, Sound, and Cloud 
are the concept variables appearing on H-6. 

With the exception of Sound, these concepts are 
logically related. H-7 includes the concepts 
Heart, Lungs, W’ind, and Fish with Cloud ap- 
pearing with a small negative coefficient. 

It is evident from the factor results that 
the three area distinctions are not clear func- 



tional distinctions; thus, the hypothesis that 
science concepts are functionally related ac- 
cording to these three conceptually-determined 
major content areas should be rejected. 

A word of caution. Too much emphasis 
should not be placed on the distinctions just 
discussed, as the intercorrelations of the 
factors are extremely high. The two factors 
of the UMLFA solution for boys are correlated 
.95. As one would expect, as the results be- 
come more specific (more factors) the factors 
are less correlated. However, for the seven 
and eight factors of the Harris R-S^ solution 
the correlations are in the .80s and .90s for 
girls and the .70s to .90s for boys; these 
correlations are very high, especially consider- 
ing that there are very few variables on many 
of the factors , 

It may be well to insert a reminder here 
that the orthogonal solutions are not very mean- 
ingful psychologically, since the complexity 
is greater than 1 for most of the concepts; most 
of the concepts appear on more than one factor. 

Further interesting aspects of studying 
these science concepts are yet to come— the 
study of the relationships of selected science 
concepts with selected concepts from the other 
three subject matter fields being studied (lan- 
guage arts, mathematics, and social studies). 
This is Step 4 of the objectives of the CAA 
Project as stated on page 1 . 

Interpretation of Factor Results for Task 
Scores . As with the concepts, the factor re- 
sults for the tasks can be interpreted at two 
levels. One level is a general one; all 12 of 
the tasks are measures of a single underlying 
ability or latent trait. This seems to be the 
most reasonable interpretation for the tasks 
since the intercorrelations of the oblique fac- 
tors are extremely high when more than one 
factor is yielded. All of the reasons for a 
general interpretation for the concepts apply 
for the interpretation of the tasks: (a) the 
intercorrelations are ail quite high and quite 
uniform— they would fit a Spearman pattern 
fairly well, (b) the correlations corrected for 
attenuation would ail be extremely high, (c) 
the eigenvalues of the correlation matrices 
are characterized by the first one being very 
large followed by a great drop in magnitude 
to the next ones, and (d) the factor intercor- 
relations are uniformly very high, indicating 
only one second -order factor. 

At a more specific level, only the oblique 
factor results are psychologically meaningful. 
These results are given in Table 14 for boys 
and Table 15 for girls. 

The oblique factor results for the science 
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tasks are essentially the same for both boys 
and girls. Alpha yielded only one common 
factor. Harris R-S^ yielded two factors which 
are correlated .91 for both boys and girls. H-l 
includes Tasks 1 through 5 and H-2 includes 
Tasks 6 through 12. (Note that Task 1 has a 
higher coefficient on H“2 for girls than it does 
on H-l.) Tasks 1 through 5 all deal with exam- 
ples of a concept. Tasks 3, 4, and 5 deal with 
examples, and nonexamples, of the selected 
concept, while Tasks 1 and 2 deal with exam- 
ples of an attributeof the selected concept which 
is, in itself, a concept. Tasks 6 through 12 
deal with other, perhaps more difficult, aspects 
of a concept such as relevant and irrelevant 
attributes, definition, supraordinate and sub- 
ordinate concepts, and a relationship with 
another concept. 

Even though the UMLFA solution yielded 
three factors for both boys and girls, it is 
very similar to the Harris R-S^ solution. U-3 
is the same as H-2 including Tasks 6 through 
12. The UMLFA solutions separate the five 
tasks appearing on H-l. For the Boys U-l 
includes Tasks 1 through 4 and U-2 includes 
Tasks 3 and 5. Note that Task 3 is of com- 
plexity 2. For the girls U-l includes Tasks 
1 , 2, 3, and 5 and U-2 includes Tasks 3, 4, 
and 5. Note that Tasks 3 and 5 are of com- 
plexity 2 for the girls , A three-factor solution 
for UMLFA is presented here; however, a two- 
factor solution may be a better one. A critical 
value of .05 was used to determine the number 
of factors for the UMLFA method. The critical 
values obtained for a two-factor solution were 
.03 and .02 for boys and girls, respectively. 
The critical values obtained for a three-factor 
solution were .66 for boys and .31 for girls. 
Tucker (1970) has shown, for a number of 
different matrices, that a critical value of 
.05 probably gives too many factors when 
there are about 200 subjects; fewer factors 
can provide a highly reasonable interpretation . 

It must be remembered that the correlations 
of these task factors , when more than one is 
yielded, are in the .90s with the exception of 
U-2 and U-3 which are correlated .87 and .83 
for boys and girls, respectively. Thus, not 
much if any emphasis should be placed on 
these distinctions just discussed. The most 
defensible interpretation is that there is a 
single common factor for these 12 tasks. 

As with the concepts, a further interesting 
aspect of studying these tasks using science 
content will be to see how they are related to 
these same tasks when language arts, mathe- 
matics, and social studies concepts are em- 
ployed as content. 
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Three-Mode Factor Analyses 

As was discussed earlier, a three-mode 
factor analysis was performed on two different 
forms of the same data to gain insight into the 
existence of any important concept-task inter- 
actions for the idealized persons. Performing 
conventional factor analyses on the two modes, 
concepts and tasks, separately is essentially 
hypothesizing that there are no interactions. 

The three-mode analyses were performed to 
determine whether this hypothesis is a tenable 
one . 

The Type I three-mode analysis is the 
analysis of the 12 tasks and the three com- 
posite concept variables; Type II is the analy- 
sis of the three composite task variables and 
the 30 concepts. Type I was performed to 
permit maximum task interactions to be evident; 
Type II to permit maximum concept interactions. 

The core matrix obtained for each analysis 
is the only piece of the three-mode analysis 
of interest here since it contains the idealized 
person components by task components by con- 
cept components. Hence, it is in this matrix 
that any interactions are seen. The core ma- 
trices obtained for Type I and Type II analyses 
are presented in Table 16 for boys and in Table 
17 for girls. Only those idealized person 
(core) components that have one or more coef- 
ficients greater than .50 (absolute) are included 
in the tables; the number of core components 
obtained in each of the analyses was equal to 
the product of the number of components for 
the two modes other than individuals . The 
variables comprising the task components are 
given in footnotes on each of the tables. The 
variables comprising the Type I concept com- 
ponents are the ten concepts in each of the 
three areas. The concept components for the 
Type II analyses bear little resemblance to 
the Harris R-S^ factors which were the basis 
for the number of components to be extracted; 
the concept components obtained are much more 
specific. Most of them have only two or three 
variables with coefficients greater than .30 
(absolute). These differences are not surpris- 
ing or critical since the oblique factors are 
extremely highly correlated. 

Both Type I and Type II analyses for the 
boys indicate that there is only one idealized 
person type— there is just one major core com- 
ponent. As indicated by the Type I analysis, 
persons respond similatT^to the concepts of 
the three different areas; the Type II analysis 
indicates some slight differentiation among 
the concepts. For the Type I analysis, a per- 



son who scores well on core component 1 tends 
to do less well on Tank 4 (task component 2). 

A person who has low scores on core component 
1 would tend to perform better on Task 4 than 
on the remaining tasks. In the Type I analysis 
there are no other coefficients greater than .75 
(absolute). Of the total of 24 core components 
obtained for the Type II analysis, there are 
only six that have any coefficients greater than 
.50 (absolute) and, except for core component 
1 , there are only two other coefficients greater 
than .75 (absolute)— they are both .76. Core 
component 1 shows that the person who has 
high scores on this component does slightly 
less well on concept components 4, 5, and 
7. Concept component 4 is a specific for the 
concept Cell; concept component 5 includes 
the concepts Muscle, Conductor, and Expan- 
sion; and concept component 7 is a doublet 
for the concepts Pore and Volcano. A person 
with low scores on core component 1 would 
score slightly better on these concepts than 
on the remaining ones. Other minor variations 
in response patterns for the idealized persons 
can be seen in Table 16. 

The three-mode results for the girls are 
essentially the same as for the boys; there is 
just one major core component indicating just 
one idealized person type. As with the boys, 
the Type I analysis indicates that girls respond 
similarly to the concepts of the three different 
areas; they do less well on Task 4 (task com- 
ponent 2) than on the remaining tasks. Of the 
total of 21 Idealized person components from 
the Type II analysis, only four have any coef- 
ficients greater than .50 (absolute) and only 
one has any coefficients greater than .75 
(absolute). This analysis indicates that girls 
with high scores on this component tend to do 
less well on concept components 4 and 5 for 
all of the tasks and on concept components 
2 and 6 for Tasks 3 and 4. Concept component 
2 includes the concepts Cell, Moon, and Con- 
ductor; concept component 4 is a doublet for 
the concepts Bird and Fossil; Lens and Sedi- 
mentary Rock are the concepts appearing on 
concept component 5; and concept component 
6 is a doublet for Invertebrate and Conductor. 
There are no other coefficients greater than 
.75 for either of the analyses for girls. Minor 
variations in response patterns for the ideal- 
ized persons can be seen in Table 17. 

The results for the three-mode factor analy- 
ses support the hypothesis that there are no 
important concept-task interactions for the 
idealized persons. Thus, it is reasonable to 
regard these two modes as independent. 



Table 16 

Three-Mode Core Results: Boys 



Type I 

Concept Components 



Idealized 

Persons 


Task 

Components 3 


Area 

1 


Area 

2 


Area 

3 


1 


1 


1.79 


1.74 


1.79 




2 


.75 


.63 


.73 




3 


1.95 


2.00 


1.87 


2 


1 


.43 


.61 


.20 




2 


.12 


. 28 


.29 




3 


-.43 


-.39 


-.56 



Idealized 

Persons 


Task 

Components 3 


1 


Type II 

Concept Components 
2 3 4 5 6 


7 


8 


1 


1 


1.29 


1.20 


1.37 


.81 


.85 


1.2,1 


■ 72 


1.10 




2 


1 . 17 


1.14 


1.05 


.77 


.60 


1.12 


.55 


.87 




3 


1.70 


1.70- 


1,62 


.96 


1.03 


1.73 


■ 97 


1.44 


2 


1 


.28 


-.09 


.18 


.17 


-.30 


.65 


.03 


.08 




2 


■ 71 


.35 


.07 


-.16 


.00 


.76 


.20 


.09 




3 


-.25 


-.39 


-.37 


-.25 


-.38 


-.35 


-.14 


-.29 


3 


1 


-.20 


-.23 


-.14 


.62 


-.27 


.05 


-.56 


.02 




2 


-.04 


-.20 


.45 


-.45 


.13 


.28 


-.32 


.07 




3 


-.01 


.07 


.31 


-.05 


.18 


-.06 


-.13 


.13 


4 


1 


-.23 


.76 


.29 


.06 


-.04 


.02 


-.04 


-.15 




2 


-.11 


-.23 


.09 


.26 


.24 


.26 


-.12 


-.49 




3 


-.09 


.01 


-.16 


.05 


.01 


-.04 


.12 


-.31 


5 


1 


.06 


-.04 


-.07 


.24 


.17 


.09 


.16 


-.36 




2 


-.08 


.21 


-.54 


-.25 


.12 


. 27 


-.45 


-.49 




3 


.11 


.12 


-.03 


-.10 


.05 


.22 


.04 


.06 


6 


1 


-.41 


-.13 


-.04 


-.01 


.28 


.27 


.28 


.05 




2 


-.11 


.05 


.01 


-.10 


.51 


-.15 


-.08 


.04 




3 


-.12 


-.03 


.06 


.01 


.20 


-.14 


-.08 


.04 



a Varlables comprising task components: 



Type 1:1- Tasks 1 , 2, 3, and 5 

2 - Task 4 

3 - Tasks 6-1 2 



Type II: 1 - Tasks 1, 2, and 4 

2 - Tasks 3 and 5 

3 - Tasks 6-1 2 
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Table 17 

Three-Mode Core Results: Girls 



Idealized 

Persons 


Task 

Components 9 


Tvoe I 

Concept Components 
Area Area Area 

1 2 3 


1 


1 


1.00 


1.00 


1.03 




2 


.73 


.58 


.81 




3 


2.31 


2.34 


2.21, 


2 


1 


-.43 


-.18 


-.28 




2 


-.40 


-.62 


-.38 




3 


.13 


.18 


.52 



Idealized 

Persons 


Task 

Components 9 


1 


Tvoe II 

Concept Components 
2 3 4 5 


6 


7 


1 


1 


2.17 


.81 


1.32 


.27 


.35 


■ 84 


1.08 




2 


1.46 


.60 


.87 


.21 


.16 


.31 


.83 




3 


2.32 


1.17 


1.87 


■ 63 


.43 


1.06 


1.61 


2 


1 


.51 


-.15 


.27 


.56 


-.21 


-.17 


.22 




2 


.47 


.02 


.51 


-.19 


-.25 


-.34 


.59 




3 


-.56 


-.45 


-.15 


-.14 


-.27 


-.37 


-.19 


3 


1 


.10 


.61 


-.20 


-.04 


.07 


-.01 


.30 




2 


-.02 


-.52 


-.37 


.22 


.30 


-.25 


.44 




3 


-.13 


-.01 


-.03 


.01 


.17 


-.06 


-.01 


4 


1 


-.15 


-.08 


-.08 


.10 


.19 


.11 


.12 




2 


-.06 


■ 54 


.10 


.07 


.45 


-.31 


.17 




3 


-.11 


.01 


-.05 


-.11 


.07 


.14 


.01 



a Varlables comprising task components: 

Type I: 1 - Tasks 3 and 5 

2 - Task 4 

3 - Tasks 6-1 2 



Type II: 1 - Tasks 1, 2, and 5 

2 - Tasks 3 and 4 

3 - Tasks 6-1 2 




32 



IV 

Summary and Conclusions 



The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil- 
ities” is to formulate one or more models or 
structures of concept attainment abilities, and 
to assess their consistency with actual data. 
This paper contains a report of the factor analy- 
tic study of the content and task dimensions 
of the science items , 

Science items to measure concept attain- 
ment were developed using a completely crossed 
design utilizing 30 concepts and 12 tasks. 

These science items were administered during 
the fall of 1970 to 186 boys and 259 girls who 
were just beginning the sixth grade. 

Two types of total scores were secured 
from the students’ responses to these items — 
a total score for each of the 30 concepts (to- 
talled across tasks) and a total score for each 
of the 12 tasks (totalled across concepts). 
Means, standard deviations, and Hoyt reliabil- 
ity estimates were obtained for each of the 
30 concept scores and each of the 12 task 
scores for each of the groups studied. 

Conventional factor analyses were per- 
formed on the intercorrelation matrices obtained 
for the concepts and for the tasks separately 
for the boys and the girls. Analyses were ob- 
tained using three initial factor methods: 

Alpha (Kaiser & Caffrey, 1965), Harris R-S 2 
(Harris, 196 2), and Unrestricted Maximum 
Likelihood Factor Analysis (Joreskog, 1967).* 
Derived orthogonal solutions were obtained 
for each of the three initial solutions using 
the Kaiser normal varimax procedure (Kaiser, 
1958),and derived oblique solutions were ob- 
tained using the Harris-Kaiser independent 
cluster solution (Harris & Kaiser, 1964), 

Three-mode factor analysis (Tucker, 1966a, 
1966b) was performed on two different forms of 
the same data to determine whether there are 
any important concept-task interactions for the 
idealized persons , 

The conventional factor results for the con- 
cepts yielded one or more orthogonal factors 



for the various methods. The concept variables 
are almost all of complexity 2, 3, and even 
greater on these factors, however. The oblique 
results tend to yield simple structure but the 
oblique factors are very highly correlated; thus, 
a main conclusion is that all 30 of the concepts 
are measures of a single functional relationship 
existing among the concepts. This holds for 
both boys and girls. 

As with the concepts, the most reasonable 
interpretation for the tasks is that all 12 of the 
tasks are measures of a single underlying abil- 
ity or latent trait. The intercorrelations of the 
oblique factors are extremely high when more 
than one factor is yielded. 

The results for the three-mode factor analy- 
ses support the hypothesis that there are no 
important concept -task interactions for the 
idealized persons. Thus, it is reasonable to 
regard these two modes as being independent, 

A further interesting aspect of studying 
these science items will be to see how they 
are related to concepts from three other subject 
matter fields (mathematics, language arts, and 
social studies) and to general cognitive abil- 
ities. The data for such a study will be col- 
lected during summer, 1971, Even though the 
most reasonable interpretation is that there is 
only a single common factor for the 30 concepts , 
the most specific results obtained were used 
to determine the science concepts to be included 
in the summer, 1971, study. This should permit 
maximal demonstration of relationships with 
concepts from other subject matter fields. The 
two concepts with the highest coefficients on 
each of the Harris R-S 2 factors for both the boys 
and girls were selected. 

On this basis a total of 21 science concepts 
were selected for further study. These concepts 
are: Bird, Cell, Heart, Invertebrate, Lens, 
Lungs, Muscle, Core, Fossil, Glacier, Meteor, 
Sedimentary Rock, Volcano, Conductor, Expan- 
sion, Friction, Liquid, Melting, Molecule, 
Sound, and Thermometer. Even though the 



jnost reasonable Interpretation for tho tasks is 
that there Is a single common factor, all 12 
of the tasks will be Included in the summer, 



1971 . study In order to have a reliable con- 
cept score (totalled across the 12 tasks for 
a single concept) . 
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Appendix A 

Orthogonal Common Factor Results for Science Concepts: Boys 8 



Concept 


Aloha 

A-l 


H-l 


H-2 


H-3 


Harris R-S‘ 
H-4 H-5 


l 

H-6 


H-7 


H-8 


UMLFA 
U-l U-2 


Area: 


Biological Science 
























1 


Bird 


77 


57 


36 














60 


48 


2 


Cell 


74 




58 














40 


65 


3 


Fish 


82 


61 










31 


31 




79 


37 


4 


Heart 


84 


46 


31 


32 


32 










63 


56 


5 


Invertebrate 


73 


38 










52 






58 


46 


6 


Lens 


77 




39 


33 








45 




47 


61 


7 


Lungs 


86 


60 




36 












73 


48 


8 


Mammal 


77 


58 










33 






68 


41 


9 


Muucle 


82 


34 




40 




36 








54 


60 


10 


Pore 


83 


50 


37 


31 




34 








60 


58 


Area: 


Earth Science 
























11 


Cloud 


86 


49 


38 


35 












59 


62 


12 


Core 


80 


41 








53 








62 


52 


13 


Fossil 


83 


59 






42 










72 


45 


14 


Glacier 


81 


66 


32 














69 


45 


15 


Meteor 


80 


33 


37 




51 










50 


63 


16 


Moon 


81 


41 


39 


35 












50 


64 


17 


Planet 


83 


46 


37 














58 


59 


18 


Sedimentary Rock 


75 


43 


43 














54 


52 


19 


Volcano 


84 


56 




33 








35 




67 


51 


20 


Wind 


84 


59 


36 






31 








69 


50 


Area: 


Physical Science 
























21 


Conductor 


71 




63 














36 


65 


22 


Evaporation 


83 


34 


39 


43 


31 










47 


70 


23 


Expansion 


82 


41 


47 


38 










31 


47 


69 


24 


Friction 


76 




42 








39 






48 


59 


25 


Liquid 


77 


39 


32 












37 


52 


57 


26 


Melting 


81 


43 




43 


32 










56 


59 


27 


Molecule 


74 




39 


55 












36 


69 


28 


Solid 


83 


58 


40 














61 


56 


29 


Sound 


81 


40 


34 




46 










56 


58 


30 


Thermometer 


81 


49 








31 




33 




64 


51 



includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 
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Appendix B 

Orthogonal Common Factor Results for Science Concepts: Girls" 



Concept 


Alpha 

A-l 


H-l 


H-2 


Harris R-S2 
H-3 H-4 H-5 


H-6 


H-7 


UMLFA 
U-l U-2 


U-3 


Area: 


Biological Science 
























1 


Bird 


68 




60 












32 


34 


56 


2 


Cell 


65 






62 












57 




3 


Fish 


78 


44 


50 












57 




52 


4 


Heart 


78 


35 


35 


33 








45 


57 


36 


42 


5 


Invertebrate 


67 




31 


31 




36 






41 


41 


33 


6 


Lens 


64 


55 














51 


34 




7 


Lungs 


84 


50 








35 




35 


71 


41 




8 


Mammal 


76 


44 


52 












48 


33 


53 


9 


Muscle 


72 


32 




45 




32 






45 


53 




10 


Pore 


80 


42 


34 




42 


38 






58 


45 


34 


Area: 


Earth Science 
























11 


Cloud 


80 


35 


39 


34 




32 






45 


51 


41 


12 


Core 


74 


48 














56 


38 


34 


13 


Fossil 


80 




55 


32 










36 


44 


61 


14 


Glacier 


76 


41 


37 






34 






54 


39 


39 


15 


Meteor 


78 




37 


52 










34 


61 


40 


16 


Moon 


80 


31 




50 


35 








41 


68 




17 


Planet 


81 


39 




32 


42 








50 


56 


32 


18 


Sedimentary Rock 


69 


54 














57 


36 




19 


Volcano 


76 


38 


34 


35 










47 


46 


37 


20 


Wind 


78 


48 


38 










31 


64 


32 


40 


Area: 


Physical Science 
























21 


Conductor 


66 






41 












58 




22 


Evaporation 


81 


32 


32 


41 


39 


34 






44 


61 


33 


23 


Expansion 


79 




33 




50 








44 


55 


38 


24 


Friction 


73 






35 


56 








34 


58 


34 


25 


Liquid 


80 


41 


36 


32 


38 








50 


49 


38 


26 


Melting 


78 


36 




33 






40 




46 


50 


38 


27 


Molecule 


65 










52 






41 


42 




28 


Solid 


79 


32 


34 




32 


34 


33 




48 


46 


43 


29 


Sound 


80 




54 


32 






31 




34 


44 


65 


30 


Thermometer 


70 


37 






32 




34 




45 


39 


38 



aincludes those variables which have coefficients greater than .30 (absolute). 



Decimals have been omitted. 
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Appendix C 

Orthogonal Common Factor Results for Science Tasks: Boys * 





Task 


Alpha 

A-l 


Harris R-S 2 
H-l H-2 


U-l 


UMLFA 

U-2 


U-3 


1 


Given name of attribute, select example. 


89 


53 


72 


60 


48 


56 


2 


Given example of attribute, select name. 


92 


57 


72 


63 


55 


42 


3 


Given name of concept, select example. 


83 


40 


80 


71 


41 


31 


4 


Given name of concept, select nonexample. 


79 


47 


66 


55 


48 




5 


Given example of concept, select name. 


90 


50 


79 


88 


46 




6 


Given concept, select relevant attribute. 


91 


80 


47 


41 


80 




7 


Given concept, select Irrelevant attribute. 


87 


76 


44 


38 


75 




8 


Given definition of concept, select name. 


93 


74 


58 


52 


73 




9 


Given name of concept, select definition. 


92 


80 


49 


46 


81 




10 


Given concept, select supraordlnate concept. 


93 


69 


61 


55 


68 




11 


Given concept, select subordinate concept. 


91 


73 


54 


51 


71 




12 


Given two concepts, select relationship. 


86 


79 


42 


36 


79 




^Includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 







Appendix D 

Orthogonal Common Factor Results for Science Tasks: Girls " 




i 

Task 


Alpha 

A-l 


Harris 

H-l 


R-S 2 

H-2 


U-l 


UMLFA 

U-2 


U-3 


l 


Given name of attribute, select example. 


88 


61 


57 


59 


49 


46 


2 


Given example of attribute, select name. 


89 


55 


67 


53' 


60 


45 


3 


Given name of concept, select example. 


86 


48 


74 


47 


70 




4 


Given name of concept, select nonexampie. 


77 


37 


76 


36 


79 




5 


Given example of concept, select name. 


86 


48 


73 


48 


69 


31 


6 


Given concept, select relevant attribute. 


89 


77 


44 


76 


39 




7 


Given concept, select irrelevant attribute. 


83 


76 


38 


75 


34 




8 


Given definition of concept, select name. 


91 


72 


51 


73 


45 


35 


9 


Given name of concept, select definition. 


93 


76 


53 


77 


48 




10 


Given concept, select supraordinate concept. 


92 


73 


55 


73 


51 




11 


Given concept, select subordinate concept. 


88 


72 


51 


73 


48 




12 


Given two concepts, select relationship. 


86 


76 


45 


76 


42 





a Includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 



ofo aa?-s?o-a 



35 




38 
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